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WE CLAIM: 

1 . An execution unit that maintains substantially peak data throughput 
in the unified execution of multiple media data streams, the execution unit having 
a data path, comprising: 

a multi-precision arithmetic uncoupled to the data path, the multi- 
precision arithmetic unit capable of dynamic partitioning based on the elemental 
width of data received from the data path; 

a switch coupled to the data path and programmable to manipulate 
data received from the data path, the ssyitch providing data streams to the data 
path; and 

an extended mathematical element coupled to the data path and 
programmable to implement additional mathematical operations at substantially 
peak data throughput. 




2. The execution tfnit defmQd-jffctyim 1, wherein the multi-precision 
execution unit is configurable to divide! the dajfc into component symbols of various 
sizes, analyze the component symbol^oased upon instructions, and re-synthesize 
the component symbols /or communication over the data path. 



20 3. The execution unit defined in claim 2, wherein the multi-precision 

execution unit is operable to perform unique operations on each component 
symbol. 

4. / The execution unit defined in claim 2, wherein the mathematical 
25 element is pperable to perform finite group, finite field, finite ring and table look- 
up operations on the symbols. 



30 



r 5. The execution unit defined in claim 1, wherein the arithmetic unit is 
programmable to perform Boolean, integer and floating point mathematical 
operations. 
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6. The execution unit defined in claim 5 7 wherein the operations 
performed by the arithmetic unit are capable of bejpg performed at various levels 
of precision. 

5 7. The execution unit defined in cl&im 1, wherein the manipulation of 

data comprises copying, shifting and re-sizing data. 

8. The execution unit defined in claim 1, further comprising control to 
maximize use of the execution unit by performing operations at peak data width of 

10 the data path. 

9. The execution unit defined in claim 2, wherein the size of 
component symbols match. 

15 10. An execution unityhaving a datjTjBath, comprising: 

at least one register file cotroled io^the data path; 
a multi-precision arithmefcrtlnu coupled to the data path, the multi- 
precision arithmetic unit capable of dyijamij/ partitioning based on the elemental 
width of data received from the data/ 
20 a switch coupled to the data path and programmable to manipulate 

data received from the cjata path, the switch providing data streams to the data 
path; and 

an extended mathematical element coupled to the data path and 
programmable to implement additional mathematical operations at substantially 
25 peak data throughput. 

11. An execution unit having a data path, comprising: 

multi-precision arithmetic unit coupled to the data path, the multi- 
precision antiemetic unit capable of dynamic partitioning based on the elemental 
30 width of data received from the data path; 
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means coupled to the data path for manipulating data received from 
the data path, the means for manipulating data^eing programmable and providing 
a data signal to the data path; and 

an extended mathematical element coupled to the data path and 
programmable to implement additional mathematical operations at substantially 
peak data throughput. 



12. A general purpose programmable media processor having an 
instruction path and a data path to digitally process a plurality of media data 
10 streams, comprising: 

a high bandwidth external interface operable to receive a plurality of 
data of various sizes from an exteipal source and communicate the received data 
over the data path at a rate that njkintains substantially peak operation of the media 
processor; 

15 at least one regisfer file configurable to receive and store data from 

the data path and to communicate the stored cMa to the data path; and 

a multi-precision executipn^mtt^coupled to the data path, the multi- 
precision execution unit configurable repartition data received from the data path 
to account for the elemental symbol spe of the plurality of media data streams, 

20 and programmable to operate on the data to generate a unified symbol output to 
the data path. 



25 
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13. The m^dia processor defined in claim 12, wherein the execution unit 
is dynamically configurable to partition data received from the data path. 

14. Thfe media processor defined in claim 12, further comprising: 
leans for moving data between registers and memory by 

performing lofd and store operations, and for coordinating the sharing of data 
among a plurality of tasks by performing synchronization operations based upon 
instructions/and data received by the execution unit; 
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sequence of execution by 
upon instructions and data 



means for securely controlling th^ 
performing branch and gateway operations bag 
received by the execution unit; and 

a memory management unit, ihe memory management unit operable 
to retrieve data and instructions for timely jand secure communication over the data 
path and instruction path. 
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15. The media processor defined in claim 14, further comprising: 

a combined instruction cache and buffer, the combined instruction 
cache and buffer dynamically allocated between cache space and buffer space to 
ensure real-time execution of multiple media instruction streams; and 

a combined data cache and buffer, the combined data cache and 
buffer dynamically allocated between cache space and buffer space to ensure real- 
time response for multiple media data streams. 



16. The media processor 
execution is ensured by dynamically 
smallest and most frequently pecuti 




claim 15, wherein real-time 
instruction buffer space to the 
of media instructions. 



17. The media processor defined in claim 15, wherein real-time 
response is ensured by dynamically allocating data buffer space to the smallest and 
most frequently accessed /working sets of media data. 
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18. The media processor defined in claim 12, wherein media data 
streams comprise Nyquist sampled inputs and outputs. 



19. The media processor defined in claim 12, wherein media data 
streams originate yfrom standard computer memory and I/O interfaces. 

30 20. fhe media processor defined in claim 12, wherein the multi- 

precision execution unit is configurable to divide the data into component symbols 
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of various sizes, analyze the component symbols' based upon instructions, and re- 
synthesize the component symbols for communication over the data path. 

21. The media processor defined An claim 12, wherein the plurality of 
media data streams comprise presentation media information, transmission media 
information, and storage media information. 
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22. The media processor deffined in claim 21, wherein presentation 
media information comprises audio, video, image, and graphical information 

23. The media processor defined in claim 21, wherein transmission 
media information comprises radio and network data transmissions; . 



24. The media processor defined i 
information comprises data encoded in movy 



25. The media processor defi 
data path is at least 128 bits. 




21, wherein storage media 
solid-state memory media. 



claim 12, wherein the width of the 



20 26. The media processor defined in claim 12, wherein the multi- 

precision execution unit comprises a dynamically partitionable arithmetic unit, a 
register controllable cross-bar switch, and an extended mathematical element. 
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27. The media processor defined in claim 24, wherein the register 
controllable ofoss-bar switch comprises a Benes network design. 



30 



The media processor defined in claim 26, wherein the register 
controU&ble cross-bar switch is programmable and is operable to manipulate 
symbols. 
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29. The media processor defined in claim 22, wherein the extended 
mathematical element is operable to perform finite group, finite field, finite ring 
and table look-up operations on the symbqls. 

30. The media processor denned in claim 12, further comprising a set 
of predefined instructions accessible tfy a user. 
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31. The media processor defined in claim 13, wherein the means for 
performing load, store, and synchronization operations and the means for 
performing branch and gateway yoperations comprises a set of predefined 
instructions accessible by a user. 
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32. The media processor defined 
instructions are combinabl^ to implement cp 
media data streams. 




iaim 31, wherein the predefined 
site functions on the plurality of 



33. A high h&ndwidth pro</es$6r interface for receiving and transmitting 
a media stream, comprising: 

a data/path, the data ]&th operable to transmit media information at 
sustained peak rate/; 

a plurality of memory controllers, the plurality of memory 
controllers coupled to the data path in series to communicate stored media 
information to And from the data path; and 

a plurality of memory elements coupled to each of the plurality of 
memory controllers in parallel, the plurality of memory elements for storing and 
retrieving Ahe media information. 
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J4. The high bandwidth processor interface defined in claim 33, 
wherein the data path comprises a plurality of data paths forming a high bandwidth 
data/channel. 
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35. The high bandwidth processor interface defined in claim 34, 
wherein the high bandwidth data channel is uni-diiectional. 

36. The high bandwidth processor interface defined in claim 33, further 
5 comprising a general purpose programmable media processor coupled to the high 

bandwidth data channel to receive, process ai/d transmit media information at 
substantially peak rates. 

37. The high bandwidth processor interface defined in claim 33, 
10 wherein the peak rate of operation comprises at least one gigabyte of information 

per second from point to point. 



38. The high bandwidth p/ocessor jnferface defined in claim 33, 
wherein the plurality of memory controller/ eadh comprise a paired link disposed 

15 between each memory controller, ythe paipsadiito each for transmitting and 

receiving plural bits of data and paving /ijrfer^ntial data inputs and outputs and a 
differential clock signal. 

39. The high bandWidth processor interface defined in claim 38, 
20 wherein the paired link further comprises a digital skew calibrator to adjust the 

plural bits of data relativ^ to the differential clock signal to eliminate skew 
between the data. 



40. The high bandwidth processor interface defined in claim 38, 
25 wherein the paired Aink further comprises a phase locked loop to eliminate jitter in 
the differential clock signal transmitted between paired links. 
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41. flTie high bandwidth processor interface defined in claim 38, 
wherein the rflural bits comprise eight bits of data. 
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42. The high bandwidth pressor interface defined in claim 38, 
wherein the paired links each former comprise termination resistors to form 
matched impedances for eaen paired link/ 



43. 
wherein the 
data chanriels 




r interface defined in claim 34, 
el comprises plural parallel high bandwidth 



44? A sy s tem for unified modia - processing comprig 

a plurality of general purpose media ppatfessors, each media 
processor operable at sustained peak data rate^id having a dynamically 
partitioned execution unit and a high bapdmdth interface, the high bandwidth 
interface coupled to external mempiy and input/output elements to receive and 
transmit data to the media oFd^essor at substantially peak rates; 

a bi-dij£(<Cional communication fabric, the plurality of media 
processors cojjpi^d to the bi-directional communication fabric to transmit and 
receiv^atfieast one media stream comprising presentation, transmission, and 
agft media information 

0. The system defined in claim 44, wherein the bi-directional 
communication fabric comprises a fiber optic network. 

The system defined in claim 44, wherein the bi-directional 
communication fabric comprises an heterogeneous network. 



The system defined in claim 44, wherein the bi-directional 
communication fabric comprises a coaxial cable network. 

The system defined in claim 44, wherein the bi-directional 
communication fabric comprises a wireless network. 
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The system defined in claim 44", wherein a subset of the plurality of 
media processors comprise network servers. 

n i 

3€TT The system defined in claim ^f, wherein the plurality of media 
5 processors are programmable by downloading program information over the bi- 
directional communication fabric. 

^4 . The system defined in claim yt, wherein the each of the plurality of 
media processors can access an idle execution unit of another media processor in a 
10 shared manner to efficiently process presentation, transmission and storage media 
information at substantially peak data rates. 

53r — The" system defined7ui c\^^0^ h^hi each m edia processor^ 
further comprises dedicated mgnrory and wherein the each of the plurality of 
15 media processors can enqJloy any unused portion of the dedicated memory of 
another mediajwtfcessor in a sWred mannerjo-efficiently store and retrieve 
presentation, transmission and storage media information at substantially peak data 



20 53. A parallel multi-processor system that maintains substantially peak 

data throughput in the unifie^execution of multiple media streams, the system 
having a data path, comprising: 

at least one high bandwidth external interface, the at least one high 
bandwidth external interface coupled^5the data path and operable to receive a 
plurality of data of Various sizes from ajtexternal source and communicate the 
received data at a/rate that maifflSns substantially peak operation of the parallel 
multi-processor/system; / / 

a plurality of register fdes, each register file having at least one 
general purf>ose register coupled to the data path and operable to store a working 
30 set of m^dia data; and 
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at least one multi-precision execution unit coupled to the data path, 
the at least one multi-precision execution unit dynamically configurable to partition 
data within a working set of media data received from the data path to account for 
the elemental symbol size of the plurality of media streams, and programmable to 
operate in parallel on working sets of data stored in the plurality of register files to 
generate a unified symbol output for elach register file. 
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54. The parallel multi-pr6cessor system defined in claim 53, wherein 
the at least one execution unit alternates in a round robin manner to operate on 
data stored in the plurality of register files. 



15 
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55. The parallel mufti-processor system defined in claim 53, further 
comprising an instruction pre/fetch pipeline. 

56. The paraUel multi-processor /system defined in claim 55, wherein 
the instruction pre-fetch pipeline comprise a super-string pipeline. 



57. The parallel multi; 
the instruction pre-feton pipeline 




r system defined in claim 55, wherein 
ses a super-spring pipeline. 



58. The parallel multi-processor system defined in claim 53, further 
comprising a data pre-fetch pipeline. 
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59. Tljfe parallel multi-processor system defined in claim 58, wherein 
the data pre-fetdh pipeline comprises a super-string pipeline. 



60. /The parallel multi-processor system defined in claim 58, wherein 
the data prefetch pipeline comprises a super-spring pipeline. 



30 61/ The parallel multi-processor system defined in claim 53, further 

comprising a requester, responder and transponder daemon. 
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62. A method for processing unify&d streams of media data, comprising 
the steps of: 

receiving a stream of unifi^B media data including presentation, 
transmission and storage information; 

dynamically partitioning ythe unified stream of media data into 
component fields of at least one bit bjfsed on the elemental symbol size of data 
received; and 

processing the unifiqfl stream of media data at substantially peak 

operation. 

63. The method defined in claim 62, wherein the step of processing the 
unified stream of media data comprises the steps of: 

storing the strqam of unifiejkmejdia data in a general register file; 




tetic operations on the stored 
med instructions, the multi- 
lean, integer and floating point 



30 



performing multi-precisic 
stream of unified media dap based or 
precision arithmetic operations inclu^ 
mathematical operations^ 

manipulating the component fields of unified media data based on 
programmed instmctioris that implement copying, shifting and re-sizing operations; 
and 

performing multi-precision mathematical operations on the stored 
stream of unified media data based on programmed instructions, the mathematical 
operations including finite group, finite field, finite ring and table look-up 
operations. 

64. / The method defined in claim 63, further comprising the steps of: 
pre-fetching instructions and data to fill instruction and data 

pipelines; i 

performing memory management operations to retrieve instructions 
and dataf from external memory; 
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storing instructions and data in instniction and data cache/buffers; 



and 



dynamically allocating buffer stoyage in the instruction and data 
cache/buffers to ensure real-time execution. 

65. The method defined in claimyfe3, further comprising the step of 
providing a set of instructions to process the stream of unified media data, the set 
of instructions including load, store, sync/ironization, branch and gateway 
instructions. 

66. The method defined in alaim 65, further comprising the step of 
programming a sequence of at least one instruction from the set of instructions. 



67. A method for achieving high bandwidth communications between a 
15 general purpose media processor and externa™ wices, comprising the steps of: 
providing a high b^dwidtlymtprfage disposed between the media 
processor and the external devicfes, the mgh bandwidth interface comprising at 
least one uni-directional channpl pair having ah input port and an output port; and 
transmitting an'd receiving a plurality of media data streams, 
20 comprising component fields of various sizes between the media processor and the 
external devices at a rate j/nat sustains substantially peak data throughput at the 
media processor. 



68. The method defined in claim 67, wherein the step of providing a 
25 high bandwidth interface further comprises providing a plurality of external 

devices, the plurality of external devices coupled in series on the at least one uni- 
directional channel pair. 



69. fhe method defined in claim 67, wherein the step of providing a 
30 high bandwidfh interface further comprises providing a plurality of parallel uni- 
directional channel pairs. 
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70. A method for processing streams of media data, comprising the 
steps of: / 

providing a bi-directional communications fabric for transmitting 
and receiving at least one stream of unified mpdia data, the at least one stream of 
5 unified media data comprising presentatknC transmission and storage information; 

and / /l^ / 

providing at least one^rogrammable media processor within the 
communications network, the at lrast one programmable media processor for 
receiving, processing and transmitting the at least one stream of unified media data 
10 over the bi-directional communications fabric. 
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